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Abstract 
Given the authority of state government over public education, one means of narrowing the best- 
practice to actual-practice gap in education is by putting forth clear state guidance and 
recommendations to schools. To date, however, little is known about the national landscape of 
procedural guidance that is readily available to practitioners looking to implement multi-tiered 
systems of support for behavior (MTSS-B). The purpose of the current study was to conduct a 
systematic review of state department of education websites in order to understand what 
guidance is afforded to local education agencies regarding MTSS-B. Results supported that 
roughly half of the states provided some form of procedural guidance for MTSS-B; however, 
both the type (e.g., what interventions to use, how often to progress monitor) and level of 
guidance varied widely. When states did provide behaviorally-specific guidance, documents 
were most likely to include specification of what types of interventions and measures to utilize; 
information less typically focused on assessment such as indications as to how often data should 
be collected and reviewed or what decision rule(s) should be used to determine student 
responsiveness. Implications for local implementation and strengthening future state-level 


guidance for MTSS-B are discussed. 
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A Review of State-Level Procedural Guidance for Implementing Multi-Tiered Systems of 
Behavioral Support (MTSS-B) 

Although much attention has been paid to the use of multi-tiered systems specifically to 
identify students with specific learning disabilities (i.e. response to intervention), a shift has been 
made in recent years toward emphasizing multi-tiered systems of support (MTSS) that integrate 
both academic and behavioral supports. The main components of MTSS include the use of (a) 
universal screening to identify risk proactively, (b) evidence-informed intervention supports of 
increasing intensity that are matched to need, and (c) ongoing assessment to inform decision 
making (e.g., Lane, Oakes, & Menzies, 2014). Conceptual models of MTSS are frequently 
presented as a “double triangle,” which simultaneously incorporates tiers of intervention and 
assessment designed to improve both academic and behavioral outcomes. Although this double 
triangle has helped to visually reinforce that academic and behavioral success are intertwined, 
and therefore should be considered in tandem, the use of parallelism across domains may also 
present drawbacks. For example, Hawken, Vincent, and Schumann (2008) noted that although 
manuals and implementation blueprints put forth by the National Association of State Directors 
of Special Education in the 2000s (Batsche et al. 2005; Elliott & Morrison, 2008) indicated that 
MTSS applies to both academics and behavior, most of the implementation guidance provided 
was strictly academic in nature (and related to the identification of specific learning disabilities 
in particular). This may lead consumers to assume that those procedures outlined for addressing 
academic concerns should extend to behavioral domains as well; however, there are unique 
considerations that must be made in implementing multi-tiered systems of support for behavior 
(MTSS-B). 


Considerations in MTSS-B 
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Although the core features and conceptual logic of MTSS are common across both 
academic and behavioral domains, there are key differences with regard to what actual use looks 
like when implementing MTSS-B (Hawken et al., 2008). Perhaps most obvious are differences in 
the types of interventions that educators use to address academic vs. behavioral concerns. Much 
work has been conducted in recent decades to build the evidence base for a variety of behavioral 
interventions for use at Tier 2. For example, across two reviews of the literature on tiered 
systems of support (i.e., Bruhn, Lane, & Hirsch, 2014; Mitchell et al., 2011), researchers 
identified two categories of intervention that were predominantly used to address student 
behavioral outcomes. The first category included intervention approaches in which a student 
meets with an adult to establish behavioral goals and then receives behavioral feedback 
throughout the course of the day (e.g., Check, Connect, & Expect, Cheney et al., 2009; Check- 
In/Check-Out/the Behavior Education Program, Crone, Horner, & Hawken, 2010). The second 
category involved social skills instruction provided in small groups. The National Center on 
Intensive Intervention (NCI) has also summarized and reviewed the evidence for several 
behavioral support strategies within their Behavioral Intervention Tools Chart 


(https://charts.intensiveintervention.org/chart/behavioral-intervention-chart), including 


antecedent strategies (e.g. using choice, increasing opportunities to respond), consequence 
strategies (e.g., differential reinforcement of other behavior, noncontingent reinforcement), and 
packaged interventions (e.g., group contingencies, self-management). 

Another key difference across MTSS for academic and behavioral domains relates to the 
tools that educators use to assess student behavior. Whereas agreement is established regarding 
general outcome measures for assessing areas of academic skill within MTSS (e.g., oral reading 


fluency, math computation), consensus surrounding general outcome measures for behavioral 
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competence is lacking (Chafouleas, Volpe, Gresham, & Cook, 2010). The extent to which tool 
development in behavioral assessment has lagged behind that for academic assessment is evident 
in the screening and progress monitoring tool charts published by the National Center on 
Intensive Intervention. For example, whereas the Academic Screening and Progress Monitoring 


Tools Charts (https://charts.intensiveintervention.org/chart/academic-screening; 


https://charts.intensiveintervention.org/chart/progress-monitoring) highlight emerging to 


convincing evidence in support of a wide range of tools from various authors, there is currently 
only one measure featured within the Behavior Screening Tools Chart (i.e., Social, Academic, 
and Emotional Behavior Risk Screener) and three within the Progress Monitoring Tools Chart 
(i.e. BASC-3 Flex Monitor, Direct Behavior Rating, systematic direct observation). 

In addition to different assessment tools across academic and behavioral domains, 
guidance may also differ with regard to how frequently assessment should occur. For example, 
whereas nearly all state departments of education either required or recommended triennial 
academic screening as of 2010 (Zirkel & Thomas, 2010), only nine of the states reviewed in 
2017 recommended frequencies for behavioral screening, which ranged from one to four times 
per year (Briesch, Chafouleas, & Chaffee, 2017). This lack of guidance on behavioral screening 
frequency may have resulted from studies that showed the scores on behavioral rating scales 
designed for screening purposes tend to remain stable over time (Dever, Dowdy, & DiStefano, 
2018; Dowdy et al., 2014; Miller, Chafouleas, Welsh, Riley-Tillman, & Fabiano, 2018), 
suggesting that additional screenings beyond a fall administration may only be necessary for 
those students exceeding a certain level of risk. Additionally, guidance has generally stated that 
academic progress monitoring should occur at least monthly at Tier 2 and biweekly or weekly at 


Tier 3 (e.g., Gersten et al., 2008; Kurns & Tilly, 2008; Zirkel & Thomas, 2010), given that the 
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academic skills being assessed (e.g., oral reading fluency) are unlikely to fluctuate significantly 
from one day—or even one week—to the next. In contrast, student behaviors such as academic 
engagement or social interactions are more likely to fluctuate over time in response to either 
internal (e.g., mood, health) or external (e.g., instruction, peers) factors. As a result, a single data 
point may be insufficient to adequately represent the student’s level of functioning (Ferguson, 
Briesch, Volpe, & Daniels, 2012). 

Finally, criteria for assessing responsiveness to intervention may look different across 
academic and behavioral domains. Criteria across domains may differ because well-defined 
benchmarks for performance or expected rates of growth do not exist for behavior in the same 
way that they do for academic concerns (Chafouleas, Volpe, et al., 2010). Whereas educators 
typically use standard benchmarks (e.g., correct words per min) to set goals for academic 
progress monitoring, acceptable behavioral performance tends to be more contextually defined 
(Hawken et al., 2008). Furthermore, although steady, incremental growth in academic skills may 
be expected as a function of intervention, student behavior is much less likely to respond in this 
manner (Chafouleas, Volpe, et al., 2010). For example, behavioral intervention may result in an 
immediate decrease in the level of a behavior (e.g., reducing the number of call outs) or may 
gradually reduce variability in responding over time (e.g., promoting more consistent levels of 
engagement in the classroom). Given unique patterns of behavioral responding, experts have 
suggested that student progress may be most appropriately assessed through the use of visual 
analysis (i.e. examination of changes in level, trend, and variability; McIntosh, Bohanon, & 
Goodman, n.d.; NCII, 2013). 

In summary, the distinguishing features of MTSS-B may necessitate deviance from the 


guidance on implementation MTSS for academics. Particularly as related to assessment, unique 
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considerations are presented for MTSS-B, such as choice of assessment tool and schedule, 
selection of more intensive support strategy, and expected performance over time. As such, it is 
important to understand how these unique considerations have been articulated within policy and 
practice guidelines supporting use of MTSS-B. 
Guidance Regarding MTSS-B 

Substantial work has been conducted in recent years to build the evidence base for 
individual components of MTSS-B; however, estimates suggest that the gap between the 
availability of best practices and their routine usage in school settings is decades (Walker, 2004). 
One means of shortening the latency between evidence availability and use is by making 
practices or initiatives a priority at the policy levels. Policies communicate a vision for where 
practice is or should be moving (Cohen & Ball, 2010), whereas guidance documents facilitate 
building a shared understanding of what best practices should look like in order to support local 
understanding and implementation (National Center on Response to Intervention, 2010). Clear 
recommendations put forth at the federal and state levels therefore have the power to influence 
day-to-day school practices, provided that sufficient training and supports are put into place 
locally (Doolittle, Horner, Bradley, Sugai, & Vincent, 2007). For example, the history of federal 
legislation regarding school wellness policy addressing nutrition and physical domains has 
demonstrated improved quality of state policy and subsequent district goals (e.g. Piekarz, 
Schermbeck, Young, Leider, Ziemann, & Chiriqui, 2016), and that state laws do impact school 
practices in favor of increased best practices (e.g. Turner et al, 2018). 

To date, the most well-known MTSS-B has been Positive Behavioral Interventions and 
Supports (PBIS; www.pbis.org). Funded by the U.S. Department of Education's Office of 


Special Education Programs (OSEP) and the Office of Elementary and Secondary Education 
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(OESE), the Technical Assistance Center on PBIS offers substantial implementation guidance 
and resources on both assessment and intervention across tiers of increased support through their 
website, events, and trainings. Within a PBIS framework, it is recommended that teams use 
multiple sources of data (e.g., academic performance data, attendance data, office discipline 
referrals, screening measures) to identify students in need of additional supports (Algozzine et 
al., 2014). In addition, the Tiered Fidelity Inventory (TFI; Algozzine et al., 2014) provides 
several examples of interventions that may be used at the Tier 2 (e.g., Check-In/Check-Out, 
Social Skills Club, Reading Buddies, Homework Club, Lunch Buddies), whereas teams are 
encouraged to develop behavioral support plans that are student-specific for those who need Tier 
3 support. Once behavioral interventions are put into place, it is noted that progress monitoring 
should be frequent and continuous (OSEP Technical Assistance Center on PBIS, 2015). Finally, 
data should be reviewed at least monthly at Tiers 2 and 3 to determine whether changes are 
needed to the plan (Algozzine et al., 2014). 

Although guidance regarding implementation of a PBIS framework has been provided at 
the national level through the Technical Assistance Center, much of the authority for directing 
local education practice within the US lies at the state level (Cohen & Spillane, 1992). As noted 
by Doolittle and colleagues (2007), “a central assumption of any state department of education is 
that recommendations, guidelines, regulations, laws, and initiatives developed by the state will 
influence educational practices available in schools” (p. 239). To date, however, little is known 
about the guidance provided by state departments of education regarding the implementation of 
MTSS-B. One exception was a recent study that sought to examine the extent to which guidance 
is specifically available regarding universal screening for social, emotional, and behavioral 


concerns (Briesch, Chafouleas, & Chaffee, 2018). Results of this study found that less than half 
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of states (43%) provided any level of guidance regarding how to implement screening to identify 
students at-risk for social, emotional, and behavioral concerns (e.g., what measures to use, how 
often to conduct assessment). When behavior-specific guidance was provided, however, states 
were most likely to provide examples of measures that could be used (e.g., office discipline 
referrals, rating scales) and least likely to indicate decision rules for identifying students at-risk 
(Briesch et al., 2018). Although results of this study suggest that guidance in the behavioral 
domain may be underdeveloped, it is unknown whether this is specific to behavioral screening or 
extends to MTSS-B more broadly. 
Purpose of Study 
The purpose of the current study was therefore to gain a national understanding of 
guidance provided by states regarding implementation of MTSS-B, particularly focused on 
assessment and intervention at Tiers 2 and 3. To achieve this goal, we conducted a systematic 
review of state department of education websites to identify applicable guidance documents. 
Specifically, we sought to answer the following research questions: 
1. To what extent do state departments of education provide information regarding 
a. The types of social, emotional, and behavioral interventions that should be used 
with those students identified as at-risk for or exhibiting behavioral concerns? 

b. Appropriate measures to use in progress monitoring for behavioral concerns? 

c. How often behavioral progress monitoring data should be collected? 

d. How often behavioral progress monitoring data should be reviewed? 

e. What decision rule(s) should be used for evaluating response to behavioral 

intervention? 


Method 
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Procedures 

In order to determine the degree to which states have provided guidance regarding 
implementation of MTSS-B, the research team conducted a systematic review of state 
department of education websites. According to the Cochrane Collaboration, “‘a systematic 
review attempts to collate all empirical evidence that fits pre-specified eligibility criteria in order 
to answer a specific research question [and] uses explicit, systematic methods that are selected 
with a view to minimizing bias, thus providing more reliable findings from which conclusions 
can be drawn and decisions made” (Higgins & Green, 2011, 1.2.2). Review procedures were 
guided by the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) 
statement (Moher et al., 2009). PRISMA is a 26-item checklist for reporting quality features of 
systematic reviews of the empirical literature. Although several of the PRISMA items are only 
applicable to systematic reviews of the empirical literature (e.g., describing methods for 
combining results across studies, assessing risk of bias), our aim was to make transparent the 
process by which we identified and selected state department of education documents for 
inclusion in the current study. In this way, we hoped to increase reader confidence that the 
obtained results accurately depicted the national landscape concerning MTSS-B guidance. 

Members of the research team included one faculty member and two graduate students in 
school psychology, all of whom possessed both conceptual and applied knowledge of MTSS. 
These three individuals—herein referred to as researchers—were involved in both carrying out 
the search procedures and coding the identified documents, as described below. 

Search procedures. The research team conducted a systematic search to identify each 
state’s MTSS implementation and guidance documents in the spring of 2017. To complete this 


search, we located the department of education websites for each U.S. state and the District of 
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Columbia. Researchers then entered the following search terms into the website’s search bar 
sequentially: multi-tiered systems of support, MTSS, positive behavior support, PBIS, response to 
intervention, RTI, Tier 2, Tier 3, progress monitoring, and formative assessment. If there was any 
mention of a multi-tiered system in the document (e.g., RTI, MTSS, PBIS), then it was saved in 
a PDF format for further review. In many cases, the department of education webpage or 
document listed external links; however, researchers only followed the links if the department of 
education clearly indicated what was included (e.g., noting that examples of assessment 
measures were provided by the National Center on Intensive Intervention). This was because, in 
many cases, state department of education websites included a long list of external links that 
were not curated. The initial search process was independently completed by the two graduate 
student researchers and any documents identified through either search were included to ensure 
that we captured as many potentially relevant documents as possible. 

Inclusion criteria. For documents to be coded, they had to pass through two gates related 
to inclusion criteria. The first phase consisted of three initial criteria. First, documents had to 
make some mention of the fact that a multi-tiered system (e.g., RTI, MTSS, PBIS) could be 
applied to behavior. This excluded any documents that focused exclusively on academics (e.g., 
MTSS guidance for reading, SLD identification manuals). Second, documents had to provide 
some aspect of procedural guidance for implementing an MTSS at Tier 2 or 3. Specifically, the 
document needed to address at least one of the five types of guidance outlined in the research 
questions at either Tier 2 and/or 3: (a) the types of interventions that should be used; (b) 
appropriate measures to use in progress monitoring; (c) how often progress monitoring data 
should be collected; (d) how often progress monitoring data should be reviewed; and (e) what 


decision rule(s) should be used for assessing response to intervention. This excluded any 
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documents that simply identified the components of an MTSS without explaining how these 
processes might be carried out. Third, documents had to contain some mention of progress 
monitoring as applied to the general population of students in K-12 settings. This thereby 
excluded any documents that focused solely on specific populations (e.g., students with 
emotional and behavioral disorders) or applied to non-school settings (e.g., afterschool 
programs). The documents that were identified for coding included MTSS implementation or 
guidance manuals, self-assessment rubrics, and “Frequently Asked Questions” documents related 
to implementation procedures. 

The goal of the second inclusion criteria gate was to ensure that coding only occurred for 
those documents in which procedural guidance was unquestionably specific to the behavioral 
domain. This inclusion criterion was applied to differentiate between guidance that might be 
assumed to apply to behavior and guidance that was clearly intended for behavior. As such, 
researchers were instructed to assess whether the documents met one of three criteria. First, we 
included all documents that exclusively focused on behavior (i.e. behavior-specific document). 
This included documents such as PBIS manuals or guidance documents for implementing 
MTSS-B in particular. Second, we included documents that addressed both academics and 
behavior (i.e. integrated MTSS), but included a section or sections that dealt specifically with 
behavior (i.e. behavior-specific section). For example, an integrated MTSS manual might include 
a section entitled “What does MTSS look like for behavior?” Third, if neither of the preceding 
inclusion criteria were met (i.e. behavior-specific document or section), a document could be 
included if behavior-specific examples were provided (i.e. behavior-specific example). For 
example, when discussing types of progress monitoring tools to use within an integrated MTSS, 


the document might note that that tools for progress monitoring student behavior include 
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observations and rating scales. If none of these criteria were satisfied—meaning that the research 
team could not be sure that the provided guidance applied specifically to behavior—the 
document was labeled as a general document and was not coded further. 

Coding procedures. If documents met all three initial inclusion criteria, the researcher 
next reviewed the eligible document and recorded any guidance that directly addressed the five 
primary research questions into a spreadsheet. First, researchers sought any references to specific 
social, emotional, and behavioral interventions that may be utilized at Tier 2 and/or 3. Specific 
interventions refer to those named in the document and could include commercially available 
(e.g., First Step to Success; Walker et al., 1998) or non-packaged (e.g., mentoring) supports. 
Second, researchers identified any references to specific types of progress monitoring measures 
that may be utilized at Tier 2 and/or 3 when assessing the effectiveness of behavioral 
interventions. Progress monitoring measures could include both validated measures (e.g., rating 
scales, systematic direct observation) and sources of extant data (e.g., attendance records, 
detentions). Third, researchers looked for any indication of how often behavioral progress 
monitoring should occur at Tier 2 and/or 3. Guidelines for data collection could be either 
quantitative (e.g., ratings should be conducted once per week) or qualitative (decisions regarding 
the frequency of data collection should be made in consideration of X, Y, or Z factors) in nature. 
Fourth, researchers sought to determine whether the document specified how often educators 
should review behavioral progress monitoring data. Similarly, this information could be either 
quantitative (e.g., data should be reviewed at least monthly) or qualitative (e.g., teams should 
establish a data review schedule in consideration of X, Y, or Z factors) in nature. Fifth, 
researchers sought to determine whether the document specified procedures or decision rules for 


making decisions regarding response to intervention (e.g., compare to a goal line; utilize visual 
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analysis). To promote understanding of the type of information being sought within each 
question, researchers were provided with examples of a few of the more common responses that 
they might expect to find (e.g., progress monitoring might occur weekly, biweekly, or monthly). 
For any procedural guidance recorded, it was also noted whether the document provided separate 
guidance for Tier 2 vs. Tier 3 implementation, or if no tier was specified. 

If the research team identified more than one relevant document for a given state, 
information from all documents was considered together. A copy of the coding protocol is 
available from the first author. 

Training procedures and interrater reliability. All documents were reviewed, 
evaluated in relation to the inclusion criteria, and subsequently coded by one of the three 
members of the research team. Training procedures focused on ensuring that each researcher 
could accurately identify the language within each document that pertained to implementing a 
MTSS. The first author reviewed two pre-identified documents with the graduate student 
researchers to model how to search for answers to the five primary research questions. The 
graduate student researchers next received a series of practice documents to review 
independently so that the accuracy of both the inclusion determination and coding could be 
assessed. Once all members of the research team had achieved 100% accuracy on the criterion 
documents, they moved on to independently review and code the documents identified through 
the web search. The reliability of both the inclusion/exclusion decision and document coding 
were assessed by having two independent researchers review each document. For each category, 
intercoder reliability was assessed by dividing the number of agreements (conservatively defined 
as the number of documents across which perfect consistency in coding was noted) by the 


number of agreements plus disagreements and multiplying this value by 100 to obtain a 
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percentage. Although interrater reliability was found to be high (perfect consistency across 98% 
of documents for inclusion decision; 86% for interventions used, 89% for progress monitoring 
measures used, 100% for frequency of progress monitoring, 91% for frequency of data review, 
95% for analysis of progress monitoring data), any discrepancies that were identified were then 
discussed and resolved by the larger research team. 
Results 

The research team downloaded a total of 181 MTSS implementation and guidance 
documents from state department of education websites. These documents were then narrowed 
down using the aforementioned inclusionary criteria (see Figure 1). This process resulted in a 
total of 61 documents that were found to meet initial inclusionary criteria and coded. After 
reviewing these 61 documents more closely, we found that three documents were duplicates and 
an additional 14 did not provide behavior-specific guidance. Therefore, the final analyses 
included a total of 44 documents. 
State-Level Guidance Regarding Implementation of MTSS-B 

Of the 51 websites reviewed, we were unable to find any state department of education- 
produced documents that provided procedural guidance regarding implementation of Tier 2 and 
3 within a MTSS-B for 11 states (22%; CA, DC, IN, LA, MA, MN, NE, NV, PA, RI, TX). In 
several cases, reviewed documents defined MTSS as involving the use of tiered interventions 
and progress monitoring; however, they did not provide any procedural detail that would answer 
one of the five research questions. Additionally, there were 14 state departments of education 
(27%; AK, AL, AR, DE, HI, IA, IL, KY, NH, OH, SC, TN, VT, WI) that provided procedural 
guidance regarding Tiers 2 and 3 within a general MTSS document but did not include behavior- 


specific guidance (i.e. the procedural guidance was not provided in a behavior-specific 
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document/section and language did not clearly state that the guidelines applied to behavior). 
Ranging from implementation checklists to technical assistance papers to comprehensive 
manuals, these documents typically began with the specification that MTSS applies to both 
academics and behavior. For example, Alaska’s Using Response to Instruction/Intervention (RTI) 
for Alaska’s Students guide noted that “RTI can be applied to all academic content areas, such as 
math, written language and reading. It can also be applied to social behavior and school 
environment” (p. 3). Subsequent procedural guidance (e.g., how often data should be collected, 
how often data should be reviewed) was therefore assumed to apply similarly to either academic 
or behavioral domains, despite the fact that the specific examples provided were often academic 
in nature. For example, four of the state departments of education only made reference to 
curriculum-based measurement when discussing possible progress monitoring tools. 

Roughly half of the state departments of education (NV = 26; 51%) provided some level of 
procedural guidance regarding the assessment of student response to social, emotional, and 
behavioral intervention (see Table 1). First, eight of these state departments of education 
produced behavior-specific documents (AZ, FL, KS, MI, MO, NC, NJ, OR, SD), meaning that 
the entire webpage, guide, or manual dealt exclusively with the behavioral domain. Whereas 
some of these documents focused exclusively on implementation of PBIS (e.g., Michigan’s 
Schoolwide Positive Behavioral Interventions and Supports Implementation Guide, Missouri 
Schoolwide Positive Behavior Support Tier 2 Team Workbook), others addressed MTSS-B more 
broadly (e.g., Florida’s Response to Intervention for Behavior: A Technical Assistance Paper, 
South Dakota Multi-Tiered Systems of Support: Implementing a Behavioral Model Process 
Guide). Second, 11 of the state departments of education produced integrated MTSS documents 


that included a behavior-specific section (CO, CT, GA, ID, MD, ME, MS, MT, NM, NY, VA). 
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As one example, the document Response to Intervention: Georgia’s Student Achievement 
Pyramid of Interventions (2011) included a section entitled RTT and Behavior that outlined how 
the RTI framework might be applied to behavioral concerns (pp. 35-36). Finally, six of the state 
departments of education produced integrated MTSS documents that included behavior-specific 
language or examples (ND, OK, UT, WA, WV, WY). For example, the Introduction to UMTSS: 
Utah Multi-Tiered System of Supports manual did not have a behavior-specific section but did 
provide examples of tools that could be used specifically for behavioral progress monitoring 
within a table. 

Guidelines for Implementing MTSS-B 

As noted above, a total of 26 state department of education-produced documents 
provided some form of procedural guidance for implementing Tiers 2 and/or 3 of a MTSS-B. 
However, both the type (e.g., what interventions to use, how often to progress monitor) and level 
of guidance varied widely (see Table 1). 

Use of social, emotional, and behavioral interventions. Roughly one-third of the state 
departments of education (N = 18; 35%) provided examples of the types of social, emotional, 
and behavioral interventions that might be used within a MTSS-B (see Table 2). The 
interventions most frequently referenced at the Tier 2 level included social skills instruction (NV = 
11), Check-in/Check-out (CICO; N = 10), mentoring programs (N = 9), behavioral skills 
instruction (N = 8), and self-management (N = 8). Although many documents simply provided a 
list of interventions appropriate for Tier 2 intervention, some documents included more detailed 
implementation guidance. For example, the Missouri Schoolwide Positive Behavior Support Tier 
2 Team Workbook devoted chapters to how to create, implement, and monitor Check-in/Check- 


out (CICO), social skills groups, and Check & Connect (Missouri Department of Elementary and 
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Secondary Education, 2014). At the Tier 3 level, state departments of education were most likely 
to recommend the development of an individualized behavior support plan (BSP; N = 12); 
however, other recommendations included either intensifying the small group supports provided 
(e.g., home-school collaboration skills instruction) or providing more comprehensive, multi- 
faceted supports (e.g., individual/family therapy, wraparound services). 

Behavioral progress monitoring tools. When state departments of education provided 
some level of guidance regarding Tiers 2 and/or 3 of a MTSS-B, they were most likely (N = 21; 
41%) to make some mention of specific assessment tools that could be used for formative 
decision making (see Table 3). The most commonly referenced tools for progress monitoring 
were Office discipline referrals (NV = 12), systematic direct observation (N = 11), point 
sheets/teacher checklists (NV = 9), data generated through an intervention (NV = 7), and teacher 
ratings (N = 6). 

Frequency of data collection and monitoring. When progress monitoring, it is 
important that data are not only collected repeatedly, but that teams also review these data 
regularly to assess whether modifications to the intervention are needed. Few state department of 
education-produced documents (NV = 9) recommended how frequently schools should collect and 
review behavioral progress monitoring data (see Table 4). At Tier 2, recommended timelines for 
data collection ranged from daily (i.e. FL, SD) to monthly (1.e. ND), whereas the review of data 
would take place every 2 to 4 weeks. At Tier 3, documents recommended that data collection 
occur more frequently, ranging from hourly to weekly. Recommendations for data review at Tier 
3—although rare—also tended to be more frequent (i.e. weekly, ongoing). Although state 


departments of education tended to provide specific timelines when data collection and 
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monitoring were addressed, in some cases it was simply noted that school teams should establish 
timelines on a case-by-case basis (i.e., NM, WY). 

Decision rules for assessing student response. State department of education 
documents were least likely to include guidance around how to analyze behavioral progress 
monitoring data to determine student responsiveness (N = 5; 10%). In all five of these cases (FL, 
KS, MS, MO, NM), however, it was recommended that progress monitoring data points be 
compared to a goal or aim line to determine whether the intervention had the desired effect. 

Discussion 

Given the role that state agencies can play in describing best practices and guiding local 
practice (Doolittle et al., 2009), the purpose of the current study was to examine the extent to 
which state departments of education have provided guidance that could be used to inform 
implementation of MTSS-B, with a specific focus on Tiers 2 and 3. Results of the current review 
found that the majority of state departments of education provided guidance regarding integrated 
models of tiered support that address both academics and behavior. However, there was great 
variability in both the breadth and specificity of guidelines related to implementation of MTSS- 
B in particular. For example, although roughly half of the state departments of education 
provided guidance around Tier 2 and/or 3 implementation, only three (i.e. FL, KS, MO) 
addressed all five questions posed in the current review (i.e. What social, emotional, and 
behavioral interventions should be used? What behavioral progress monitoring measures should 
be used? How often should behavioral progress monitoring data be collected? How often should 
behavioral progress monitoring data be reviewed? What decision rule(s) should be used for 
assessing response to social, emotional, and behavioral intervention?). As illustrated in Table 1, 


some components of MTSS-B received greater emphasis than others. 
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Within any MTSS, it is understood that students who have been identified as at-risk 
through systematic screening procedures are provided with tiered, evidence-based intervention 
supports to address identified areas of need. What is perhaps less clear, however, is what 
interventions are appropriate and available for use within the behavioral domain. As noted 
previously, reviews of the literature on tiered systems of support (i.e., Bruhn, Lane, & Hirsch, 
2014; Mitchell et al., 2011) have consistently identified two categories of evidence-based Tier 2 
intervention: mentoring interventions (e.g., Check-In/Check-Out, Crone et al., 2004; Check & 
Connect; Cheney et al., 2009) and social skills groups. The frequency with which these two 
categories of intervention have been represented in the empirical literature interestingly aligned 
with their frequency within the current review. That is, the two most frequently referenced Tier 2 
interventions by state departments of education were Check-In/Check-Out and social skills 
instruction. There were, however, many more social, emotional, and behavioral interventions 
referenced (i.e. 21 at Tier 2, 12 at Tier 3) than fit within these two categories. Several of these 
interventions have strong empirical support and are featured within the NCII’s Behavioral 
Intervention Tools Chart (e.g., contingency management, daily report card, self-management). 
At the same time, however, there were several interventions referenced for which both 
implementation guidance and empirical support is less clear (e.g., Lunch Buddies, Newcomers 
Club). Given the power of suggestion that state-produced guidance may have on local practice, it 
is important that those interventions endorsed—whether directly or indirectly—have sufficient 
evidence to support their use. The Missouri Department of Elementary and Secondary 
Education’s (2014) Schoolwide Positive Behavior Support Tier 2 Team Workbook was one of the 
only resources identified that both provided detailed implementation guidance for recommended 


interventions and described their evidence base. 
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Although the implementation of evidence-based interventions is essential to effective 
MTSS-B, the assessment of students’ response to social, emotional, and behavioral interventions 
is equally critical. This involves not only measuring student behavior in a formative fashion but 
also making decisions as to whether the behavior has improved. Although CBM has long been 
the gold standard in academic progress monitoring, there has been less consensus within the field 
regarding behavioral progress monitoring tools (Chafouleas et al., 2010). Briesch and Volpe 
(2007) suggested that there may be four categories of behavioral progress monitoring tools (i.e. 
direct behavior rating, permanent products, rating scales, systematic direct observation), and the 
majority of measures identified within the current review fell under one of these categories. In 
addition to 11 state departments of education referencing systematic direct observation and 10 
state departments of education referencing some form of teacher ratings (i.e., point sheets, Direct 
Behavior Rating, rating scales, teacher ratings), it was also very common for state departments of 
education to recommend the use of permanent product data, including attendance, behavior 
incident reports, detentions, intervention data, office discipline referrals, suspension/expulsion 
records, and work completion/samples. Unfortunately, however, very few documents included an 
explanation of what the progress monitoring tool looked like or how it could be used. As such, it 
was often difficult to ascertain whether the same tool was potentially referenced by different 
names (e.g., point sheets, teacher ratings) or to know how one might access/develop the tool 
referenced. 

Descriptions of MTSS-B typically specify that the frequency of data collection should 
increase as students move to subsequent tiers; however, relatively few state departments of 
education (N = 9) provided specific timelines for data collection at each tier. In examining state 


department of education guidance surrounding the use of RTI to identify students with SLD, 
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Zirkel and Thomas (2010) found the greatest level of consensus around bimonthly progress 
monitoring at Tier 2 and weekly progress monitoring at Tier 3. In contrast, the timelines for data 
collection within the current review were often more intensive (e.g., as often as daily at Tier 2 
and hourly at Tier 3). This discrepancy seems to make sense given the nature of the constructs 
involved. For example, as noted previously, whereas one would not expect a student’s rate of 
oral reading fluency to substantially fluctuate within a given week, the measurement of student 
social behavior (e.g., academic engagement, non-compliance) is influenced to a greater degree 
by both internal (e.g., mood, motivation) and environmental factors (e.g., quality of instruction, 
peer influences). For this reason, studies have shown that one to two weeks’ worth of daily data 
may be needed to obtain a dependable estimate of student behavior at one point in time (e.g., 
Chafouleas, Briesch, et al., 2010; Volpe, McConaughy, & Achenbach, 2009). Although limited, 
the guidance identified within this review seems to indicate that more frequent assessment may 
be needed to obtain a dependable estimate of student behavior than is necessary when assessing 
academic skills. 

Within MTSS-B, the decision of whether to move a student from one tier of intervention 
to the next is made based on how well the student responds to evidence-based intervention. 
There are two questions that must be answered in judging responsiveness: how long should the 
intervention be in place and what decision rules will be used to judge responsiveness? When 
considering the use of RTI to identify students with SLD, it has been most common for state 
departments of education to recommend implementing an intervention for 6-8 weeks before 
assessing student responsiveness (e.g., Hauerwas et al., 2013; Zirkel & Thomas, 2010). Within 
the current review, however, timelines for the review of SEB data were notably shorter (e.g., 


ranging from biweekly to monthly at the Tier 2 level and weekly to ongoing at the Tier 3 level). 
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This is not surprising, given the recommendations that SEB data be collected more frequently 
than academic data. With more frequent data collection, it is therefore possible to more quickly 
establish whether there has been an adequate pattern of responding. Where behavior-specific 
guidance appears to be particularly underdeveloped is concerning the decision rules for 
determining intervention response. Only five state departments of education provided guidance 
in this area, and all focused on approaches that have traditionally been used for determining 
response to academic intervention (e.g., comparison to goal line; Fuchs, 2003). Unfortunately, 
problems may arise in extending this decision rule to behavioral domains. As noted previously, 
baseline levels of behavior may be so variable as to make establishing a goal line difficult and 
behavioral growth is often non-linear (Chafouleas, Volpe, et al., 2010). Researchers have 
suggested that the effectiveness of social, emotional, and behavioral interventions may best be 
assessed using the analytic conventions of single-case design, given that we are often interested 
in whether patterns of behavior changes in response to intervention (Chafouleas, Riley-Tillman, 
& Sugai, 2007; Gresham, 2005; National Center on Intensive Intervention, 2013). That is, one 
may use visual analysis examine changes in level, trend, and/or variability across baseline and 
intervention phases, or may calculate quantitative estimates of reliable change in behavior, such 
as the percent of nonoverlapping data points (Mastropieri & Scruggs, 1986) or the standardized 
mean effect size estimate (Busk & Serlin, 1992). No reference was found to either analytic 
convention of single-case design, however, within the documents reviewed. 
Limitations 

Although the results of the current study serve to highlight the range of guidance that 
exists for implementing MTSS-B, there are limitations that should be noted. First, we chose to 


restrict the document search to information publicly posted on state department of education 
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websites in order to ensure standardization across states. States may provide materials to school 
districts through other avenues, such as in-person trainings; however, such information was not 
accounted for given that our goal was to identify guidance that would be universally accessible 
to all schools in the state. We also acknowledge that school districts may receive—and, in fact, 
possibly rely on—guidance from other agencies as well. As one example, the Delaware Positive 
Behavior Support project hosts a website (http://wh1.oet.udel.edu/pbs/) that provides extensive 
guidance to schools regarding PBIS implementation; however, this information was not 
referenced within the Delaware Department of Education website. 

Related, we used the search bar within each state department of education website to 
identify documents; however, it is possible that some potentially relevant documents were 
missed through this process. The extent to which individual state departments of education 
regularly update their websites, as well as the quality of the search tool, was unknown. Verifying 
each of the identified documents with the respective state department of education would have 
increased confidence in the study results. 

Third, the documents described herein were identified during the spring of 2017, and 
therefore only represent a snapshot of what publicly-available guidance looked like at one point 
in time. We acknowledge that work continues to be done in this area, and that the information 
presented here may already be changing. For example, in reaching out to stakeholders, we were 
informed that the Michigan Department of Education is working with the National 
Implementation Research Network to develop a MTSS Practice Profile, which was not yet 
available to the public. In addition, we learned that the Missouri Council of Special Education 
Administrators was developing a guide that would provide MTSS guidance more broadly. 


Conclusions 
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Studies assessing teacher knowledge, skills, and attitudes with MTSS implementation 
have demonstrated a resounding need: educators want to be equipped with tangible tools and 
resources, as well as ongoing professional development, to increase their confidence and 
efficiency in carrying out intervention and assessment practices (Castro-Villareal et al., 2014; 
Meyer & Behar-Horenstein, 2015). Although the research community has offered 
recommendations surrounding how to implement components of MTSS-B (e.g., Chafouleas, 
Volpe, et al., 2010; Gresham, 2005; Hawken et al., 2008; National Center on Intensive 
Intervention, 2013), findings of the current study indicate that the guidance provided by state 
departments of education has been somewhat limited to date. The fact that only three state 
departments of education provided comprehensive procedural guidance regarding 
implementation of MTSS-B suggests that much work needs to be done in this area. The 
documents produced by Florida, Kansas, and Missouri may serve both as models for other state 
departments of education, and as important references for school-based practitioners, in thinking 
about the implementation of MTSS-B. 

At the same time, however, it is important to note that the guidance provided within any 
one of these documents is not definitive, and that the results of the current review suggest that a 
great deal of variability exists across states currently with regard to MTSS-B implementation 
guidelines. This lack of consensus across state-level documents has important implications for 
both future research and policy. For one, lack of consensus indicates that additional research is 
warranted to understand which procedures facilitate the most effective and efficient decision 
making, and thus have the greatest impact on student outcomes. For example, although more 
frequent monitoring may be warranted when assessing student behaviors, it is unclear whether 


there is added value in conducting assessments daily as opposed to weekly. Additionally, 
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numerous intervention strategies and progress monitoring tools were noted in the documents 
reviewed; however, these tools vary widely with regard to the evidence behind them. Careful 
curating, whether by individual states or national agencies/organizations would be helpful in 
ensuring that best practices are advocated. Finally, one way in which to promote greater 
consistency across state-produced documents is through the development of model blueprints at 
the national level. The RTI implementation blueprints put forth in the 2000s by the National 
Association of State Directors of Special Education (i.e. Batsche et al. 2005; Elliott & Morrison, 
2008), for example, served as models for the development of state-level guidance documents. 
Although such implementation blueprints are available for PBIS implementation (e.g., TFI), they 
do not currently exist for MTSS-B more broadly. Establishing such guidance at the national 


level, however, could help to move schools toward more unified implementation of MTSS-B. 
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Table 1. 


Response to Behavioral Intervention Procedural Guidance by State 
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State Document Interventions Progress Data Collection Data Review Decision Rules 

Type Monitoring Frequency Frequency for Response to 
Measures Intervention 

AK GD -- as x aS 2 

AL GD -- ze =e a as 

AR GD -- -- a as i 

AZ BSD T2, T3 T2, T3 -- se Je 

CA -- -- -- -- -- -- 

CO BSS -- NTS -- = fe 

CT BSS T2, T3 T2 -- we ge 

DC -- -- -- -- -- -- 

DE GD -- 7 a = fe 

FL BSD T3 T2, T3 12,13 D2 NTS 

GA BSS T2, T3 T2 -- = ee 


HI 


IA 


MS 


MT 


BSS 


BSS 
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NTS 


SD 


TN 


NTS 
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TX = - 2 i a a 
UT BSE 10) us 2 £ e 

VA BSS a NTS ge _ = 

VT GD fs 2 Le * = 
WA BSE 10) NTS 173 sf 2 

WI GD & fs es a = 
WV BSE T2, T3 T2 4 us 
WY BSE T2, T3 T2, NTS T3 T3 2 
Number 18/51 21/51 9/51 9/51 5/51 
Percentage (35%) (41%) (18%) (18%) (10%) 


Note. BSE = behavior-specific example; BSS = behavior-specific section; BSD = behavior-specific document; GD = general 


document; NTS = no tier specified; T2 = Tier 2; T3 = Tier 3 


Table 2. 


Recommendations for Tier 2 and 3 Behavioral Intervention 
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Tier 2 Tier 3 
Academic Support AZ, CT, MI, MO, NY, OK AZ 
Behavior Contract CT, MI, NY, OR, WV, WY 
Behavioral Skill Instruction GA, KS, MS, NJ, OR, SD, WA, WV CT, WY 
Character Education MS 
Check and Connect KS, MO, NY, SD 
Check-in/Check-out CT, KS, MI, MO, NJ, NY, OR, SD, UT, 

WY 
Class intervention SD 
Community referral WV WV 
Contingency Management AZ, CT, MS, WV 
Daily Report Card MS, WY 
Family Therapy WY 
First Step MO OR 


Group Counseling 
Home-School Collaboration 
Individual Counseling 


Individualized Behavior Support Plan 


Juvenile Court Counseling 
Lunch Buddies 

Mentoring 

Newcomers Club 

Parent Training 

School Climate 
Self-Management 


Social Skills Instruction 


Wrap-around Services 


AZ, SD, WA, WV, WY 


CT, MI 


MI 


MI 


AZ, CT, MI, NY, OK, OR, SD, WV, WY 


KS, MI 
OR, WV 
CT, OK 


AZ, CT, KS, MO, NY, OK, SD, WV 


AZ, CT, GA, KS, MI, MO, MS, NY, OK, 


SD, WY 
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CT 

CT, WY 

AZ, CT, FL, GA, ID, KS, ML, NY, OR, SD, 
WV, WY 


OR 


CT, WV 


AZ, WV 


AZ, CT, OR, WV, WY 


Table 3. 


Recommendations for Behavioral Progress Monitoring Measures 
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Tier 2 Tier 3 No Tier Specified 
Academic Performance ID 
Attendance KS, MI, MO, SD ID, OR 
Behavior Incident Reports MI MO ID 
Behavior Report Cards/ Point Sheets/Checklists CT, FL, GA, KS, WV ME, SD, VA 
NM, OR, SD, WV 
Counselor/ Mentor Reports WV WV 
Detentions ID 
Direct Behavior Rating WY FL NC 
Individualized data collection methods OR 
Intervention Data AZ, CT, MI, MO AZ, FL, WV OR 
Interviews/surveys FL 
Office Discipline Referrals AZ, CT, FL, MT, FL, WV ID, OR, SD, VA, 


ND, OK, WV, WY 


WA, WY 


Parent Data 

Permanent Products 

Rating Scales 

Requests for Assistance 
Suspension/Expulsion Records 


Systematic Direct Observation 


Teacher Ratings 


Work Completion/Samples 


CT WV 
AZ, GA, WY FL, 

FL 

FL Bi 

AZ, CT, FL, ND, FL, WV 
OK, WV, WY 


FL, KS, MI, SD,WV WV 


MO 
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NC 


ME 


ID, OR 


CO, NC, VA, WA 


WA 
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Table 4. 


Recommendations for Frequency of Behavioral Progress Monitoring Data Collection and Review 


Tier 2 Tier 3 No Tier Specified 

Data Collection Daily (FL, SD) Hourly, daily, or weekly (FL, Daily (OR) 
KS, SD) 

Weekly (MO) Weekly (WA) 

Bimonthly (WA) 

Monthly (ND) 

Team decision (NM) Team decision (NM, WY) Team decision (SD) 
Review of Data _ Biweekly (FL, KS, SD) Weekly (ND) 4-6 weeks (OR) 


8 data points in 3 weeks (MO) 
Bimonthly to monthly (MI) 
Ongoing (MI) 


Team decision (NM) Team decision (NM, WY) 


Figure 1. Document inclusion flowchart 


Total number of documents 
identified and screened for 
inclusion 
(n= 181) 


Total number of documents 
meeting inclusion criteria 
(n= 61) 


Total number of unique 
documents meeting inclusion 
and providing behavior- 
specific guidance (n = 44) 
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Reasons for Exclusion 
Does not provide specific guidance (n = 107) 
Only Pre-K (n = 11) 
Only applied to specific setting (n = 2) 


Reasons for Exclusion 
Did not include SEB-specific language (” = 14) 
Duplicate document (n = 3) 


